Assessing the reliability of the M5-120 on Amazon's mechanical Turk
نویسندگان
چکیده
0747-5632/$ see front matter 2013 Elsevier Ltd. All rights reserved. http://dx.doi.org/10.1016/j.chb.2013.02.020 ⇑ Corresponding author. Address: 492 Timberlea Drive Apartment 101, Rochester Hills, MI 48309, United States. Tel.: +1 919 88
منابع مشابه
An online daily diary study of alcohol use using Amazon's Mechanical Turk.
INTRODUCTION AND AIMS In recent years, unprecedented levels of Internet access and the widespread growth of emergent communication technologies have resulted in significantly greater population access for substance use researchers. Despite the research potential of such technologies, the use of the Internet to recruit individuals for participation in event-level research has been limited. The p...
متن کاملDocument Image Collection Using Amazon's Mechanical Turk
We present findings from a collaborative effort aimed at testing the feasibility of using Amazon’s Mechanical Turk as a data collection platform to build a corpus of document images. Experimental design and implementation workflow are described. Preliminary findings and directions for future work are also discussed.
متن کاملUsing Amazon's Mechanical Turk for Annotating Medical Named Entities.
Amazon's Mechanical Turk (AMT) service is becoming increasingly popular in Natural Language Processing (NLP) research. In this poster, we report our findings in using AMT to annotate biomedical text extracted from clinical trial descriptions with three entity types: medical condition, medication, and laboratory test. We also describe our observations on AMT workers' annotations.
متن کاملCreating Speech and Language Data With Amazon's Mechanical Turk
In this paper we give an introduction to using Amazon’s Mechanical Turk crowdsourcing platform for the purpose of collecting data for human language technologies. We survey the papers published in the NAACL2010 Workshop. 24 researchers participated in the workshop’s shared task to create data for speech and language applications with $100.
متن کاملAnnotating Large Email Datasets for Named Entity Recognition with Mechanical Turk
Amazon's Mechanical Turk service has been successfully applied to many natural language processing tasks. However, the task of named entity recognition presents unique challenges. In a large annotation task involving over 20,000 emails, we demonstrate that a compet itive bonus system and interannotator agree ment can be used to improve the quality of named entity annotations from Mechanical ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Computers in Human Behavior
دوره 29 شماره
صفحات -
تاریخ انتشار 2013